Video transmission apparatus and control method for video transmission apparatus

ABSTRACT

Waiting-for-transmission fragments that cannot be transmitted by a transmission unit due to the interruption of transmission by the transmission unit are stored. In accordance with the waiting-for-transmission fragments, a fragment to be transmitted prior to a first fragment including an intra-coded frame is eliminated from the waiting-for-transmission fragments. The transmission unit is controlled so that the first fragment is transmitted at the resumption of transmission.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.12/549,280 filed Aug. 27, 2009, which claims priority from JapanesePatent Application No. 2008-222020 filed Aug. 29, 2008, the entirecontents of all which are hereby incorporated by reference in theirentireties.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a video transmission apparatus thattransmits video data for each video frame group including one or moreencoded video frames.

2. Description of the Related Art

For example, Japanese Patent Laid-Open No. 2005-086362 discloses atechnique in which in a case where video transmission is delayed orinterrupted due to network trouble or the like, a past video frame groupthat was not able to be transmitted is eliminated and the latest videoframe group is transmitted so that delay can be reduced.

In a technique disclosed in Japanese Patent Laid-Open No. 2004-056819,in addition to a first encoding unit configured to generate inter-framepredictive coded first video data, a second encoding unit configured togenerate intra-frame predictive coded second video data is provided. Atthe resumption of transmission, the second video data is transmitted asa complement to the first video data, and the second video data isdecoded in advance. Consequently, even if transmission is resumed from amiddle portion of a group of pictures (GOP), video data can be correctlydecoded and played back.

However, in a system disclosed in Japanese Patent Laid-Open No.2004-056819, a special function of receiving two types of video data andswitching between them needs to be incorporated into a receptionapparatus. Thus, it is difficult for the reception apparatus to playback video data by using a general playback process. In general, videodata is played back using a media player such as QuickTime Player orWindows Media Player. Furthermore, it is necessary for a transmissionapparatus to include a plurality of encoding units supporting differentencoding methods. Thus, problems relating to complication of thehardware configuration and an increase in the load of softwareprocessing occur.

In the case of an MP4 file format, a movie fragment (hereinafter,referred to as a “fragment”), which is the unit of transmission, may bedefined as in one of the following options:

(1) A group of video object planes (GOV) including video frames from areference video frame that is encoded without inter-frame prediction tothe video frame that is immediately before the next reference videoframe, is defined as a fragment.

(2) Each of a plurality of sections obtained by dividing a GOV isdefined as a fragment.

In the case of option (1), a fragment always starts from an I-frame(intra-coded frame: a video frame that has been encoded using only datawithin the frame). However, in the case of option (2), some fragmentsstart from a video frame other than an I-frame, such as a P-frame(predicted frame: a video frame holding differential information on theimmediately preceding video frame).

Thus, in a method for simply skipping to the latest fragment to resumetransmission as in Japanese Patent Laid-Open No. 2005-086362, in a casewhere a fragment is defined as in option (2), decoding cannot beperformed and an error occurs in a general playback method.

Even in such a case, when a reception apparatus includes a decoding unithaving a special function of ignoring video frames in a fragment notincluding an I-frame up to the frame immediately before the nextI-frame, video playback can be continued. However, general network mediaplayers do not include a decoding unit having such a special function.In addition, even if a reception apparatus independently includes adecoding unit having such a function, complicated processing isrequired, resulting in an increase in the processing load.

In addition, in a case where the length of a GOV is long (the number offrames is large), when transmission is resumed from the fragmentstarting from a P-frame that is immediately after a fragment startingfrom an I-frame, video is stopped for a long period of time until thenext I-frame appears.

SUMMARY OF THE INVENTION

The present invention solves the above-described problems.

According to an aspect of the present invention, a transmissionapparatus includes a transmission unit configured to transmit a fragmentof one or more frames including an intra-coded frame and a fragment ofone or more inter-coded frames; a storage unit configured to storewaiting-for-transmission fragments that are not able to be transmittedby the transmission unit due to interruption of transmission by thetransmission unit; an elimination unit configured to eliminate afragment to be transmitted prior to a first fragment including anintra-coded frame from the waiting-for-transmission fragments, inaccordance with the stored waiting-for-transmission fragments; and acontrol unit configured to control the transmission unit to transmit thefirst fragment at the resumption of transmission.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a video transmission apparatus according toan embodiment of the present invention.

FIG. 2 is a flowchart showing a fragment generation process.

FIG. 3 illustrates an example of fragment information stored in awaiting-for-transmission queue.

FIG. 4 is a flowchart showing a fragment transmission process.

FIG. 5 illustrates fragments transmitted from a video transmissionapparatus and fragments played back by an external apparatus.

DESCRIPTION OF THE EMBODIMENTS

Embodiments of the present invention will be described with reference tothe drawings.

In the following description, each of a plurality of sections obtainedby dividing a GOV is defined as a fragment (frame group). A GOVrepresents a frame group of video frames from a video frame (I-frame)encoded without using inter-frame prediction to the video frameimmediately before the next video frame (I-frame). An I-frame representsa video frame that has been encoded using data within the video framewithout using data of the previous or next frame. In this embodiment,such an I-frame is referred to as a “reference frame”. In addition, aP-frame is a video frame holding a difference from the previous videoframe and is an example of a video frame encoded using data of othervideo frames. In this embodiment, instead of a P-frame, another type ofvideo frame encoded using data of other video frames may be used.

FIG. 1 is a block diagram of a video transmission apparatus according tothis embodiment.

The video transmission apparatus includes a photographing unit 1-1, anencoding unit 1-2, a temporary storage unit 1-3, a control unit 1-4, anda communication unit 1-5. The photographing unit 1-1 includes an imagepickup element and generates video frames. The encoding unit 1-2 is anencoding circuit that performs inter-frame predictive encoding andintra-frame predictive encoding of the generated video frames. Thetemporary storage unit 1-3 includes a memory in which the encoded videoframes are temporarily stored. The control unit 1-4 controls the entirevideo transmission apparatus. More specifically, the control unit 1-4includes a computer-readable memory in which a program for causing acomputer to perform processing of the control unit 1-4 is stored and acentral processing unit (CPU) that performs the processing in accordancewith the program. The communication unit 1-5 is a communication circuitthat performs, via a network 1-6, transmission of encoded video framesand reception of a request from an external apparatus. The network 1-6is, for example, the Internet.

The control unit 1-4 of the video transmission apparatus according tothis embodiment stores waiting-for-transmission queue information 1-41in a memory, and generates or eliminates a fragment by controllinginformation on the fragment in accordance with thewaiting-for-transmission queue information 1-41.

FIG. 2 is a flowchart of a fragment generation process performed by thecontrol unit 1-4 of the video transmission apparatus.

In step S21, the communication unit 1-5 receives a video transmissionrequest from an external apparatus via the network 1-6. In response tothis request, the control unit 1-4 starts the fragment generationprocess. The control unit 1-4 causes the encoding unit 1-2 to encodevideo frames, and stores the encoded video frames in the temporarystorage unit 1-3.

In step S22, the control unit 1-4 determines whether or not the numberof video frames stored in the temporary storage unit 1-3 has reached apredetermined number of frames. In a case where the number of storedframes has not reached the predetermined number of frames (NO in stepS22), the control unit 1-4 repeats the processing of step S21.Meanwhile, in a case where the number of stored frames has reached thepredetermined number of frames (YES in step S22), the control unit 1-4proceeds to step S23.

In a case where the number of stored video frames has reached thepredetermined number of frames, the control unit 1-4 generates fragmentsinto which the video frames are grouped in step S23.

In step S24, the control unit 1-4 holds the waiting-for-transmissionqueue information 1-41 on fragments so that information onwaiting-for-transmission fragments (fragments to be transmitted) iscontrolled. Then, the control unit 1-4 sequentially transmits the storedfragments to the external apparatus from which the request has beenreceived. After transmission has been completed, the control unit 1-4deletes data of video frames of the transmitted fragments stored in thememory of the temporary storage unit 1-3. In addition, the control unit1-4 checks the number of untransmitted fragments by referring to thewaiting-for-transmission queue information 1-41.

In step S25, the control unit 1-4 checks whether or not the number ofuntransmitted fragments is greater than the upper limit. In a case wherethe number of untransmitted fragments is greater than the upper limit(YES in step S25), it can be considered that transmission is not beingperformed, for example, because the video transmission apparatus is in atransmission interruption state.

Thus, in a case where the number of untransmitted fragments is greaterthan the upper limit, the control unit 1-4 eliminates one or morefragments of the untransmitted fragments selected in accordance with apredetermined rule described later in step S26. That is, data of videoframes of the selected one or more fragments is deleted from the memoryof the temporary storage unit 1-3. Although in step S26 the processingis performed in accordance with the number of fragments, the processingmay be performed in accordance with the number of video frames. Thenumber of fragments may be replaced with another value as long as thevalue is associated with the fragment transmission state.

Meanwhile, in a case where the number of untransmitted fragments is notgreater than the upper limit (NO in step S25) or elimination of the oneor more untransmitted fragments in step S26 has been completed, theprocess proceeds to step S27. In step S27, the control unit 1-4 storesthe fragments newly generated in step S23 in the temporary storage unit1-3 and adds information on the newly generated fragments to thewaiting-for-transmission queue information 1-41.

In step S28, in order to determine whether or not video transmission isto be continued, the control unit 1-4 checks for the termination of theconnection with the external apparatus from which the request has beenreceived.

In step S29, the control unit 1-4 determines whether or not theconnection with the external apparatus has been completely terminated.In a case where it is determined that the connection with the externalapparatus from which the request has been received is still active (NOin step S29), the process returns to step S21 to continue the fragmentgeneration process. Meanwhile, in a case where it is determined that theconnection with the external reception apparatus has been completelyterminated (YES in step S29) and there is no need to continuetransmission of a video frame, the fragment generation process iscompleted.

The processing of step S21 is performed every interval at which theencoding unit 1-2 outputs a video frame. The processing of steps S22 toS28 does not depend on the communication state of a network. Thus, in acase where the same network communication state is continued and a statein which all the fragments cannot be transmitted is continued,elimination of one or more fragments in step S26 is regularly performed.Note that as shown in FIG. 4, a fragment transmission process isperformed independent of the fragment generation process.

FIG. 3 shows a specific example of the waiting-for-transmission queueinformation 1-41.

The waiting-for-transmission queue information 1-41 regards the fragmentID, the pointer, the reference frame (I-frame) generation time, thetransmission flag, and the presence or absence of the reference frame ofeach fragment.

The fragment ID represents the identification number of a fragment andis provided in accordance with the order in which fragments weregenerated. The pointer represents the position of the temporary storageunit 1-3 at which the entity of the fragment is stored. The referenceframe generation time represents the time at which the initial referenceframe (I-frame) of a GOV to which the fragment belongs was generated.The transmission flag represents whether or not the fragment has beentransmitted. The reference frame flag represents whether the fragmentincludes a reference frame (I-frame). In a case where the fragmentincludes a reference frame, the reference frame flag indicates “1”.Meanwhile, in a case where the fragment does not include a referenceframe, the reference frame flag indicates “0”. Such information isupdated in such a manner that the current state is always reflected.

Note that such information is merely an example. All the information isnot necessarily essential. For example, in a case where thewaiting-for-transmission queue information includes only information onuntransmitted fragments, a transmission flag is not necessary. Even insuch a case, a GOV to which a fragment belongs can be determined inaccordance with the reference frame generation time, and thus no problemoccurs.

In the specific example of FIG. 3, a fragment is generated every 333milliseconds, and a GOV is generated every 1000 milliseconds. Thus, aGOV includes three fragments. In addition, fragments whose IDs are “1”,“4”, “7”, and “10” are defined as fragments starting from a referenceframe (I-frame). Fragments whose IDs are “1” and “2” have already beentransmitted, and transmission is interrupted immediately after thefragment whose ID is “2” is transmitted. Therefore, fragments whose IDsare “3” and larger values have not been transmitted.

In a case where the upper limit of the number of untransmitted fragmentsis set to nine, when a fragment whose ID is “12” is generated, thenumber of untransmitted fragments becomes ten, which is greater than theupper limit. In this case, in order to ensure the real-time property,one or more fragments are eliminated in step S26 of FIG. 2. In thisembodiment, fragments including the oldest fragment to the fragmentimmediately before the most recently encoded reference frame (I-frame)among untransmitted fragments are eliminated. In the case of FIG. 3,fragments whose IDs are “3” to “9” are eliminated. Here, the controlunit 1-4 can delete data of video frames of fragments having differentreference frame generation times from the memory of temporary storageunit 1-3. In addition, the control unit 1-4 may detect a fragmentincluding the newest reference frame by referring to a fragment ID and areference frame flag. In this case, the control unit 1-4 deletesfragments including the oldest fragment to the fragment immediatelybefore the detected fragment from the memory of the temporary storageunit 1-3. That is, since transmission of these fragments is restricted,the real-time property of video playback by an external apparatus can beensured. In addition, since transmission of video frames is restrictedin units of fragments, playback can be achieved with an externalreception apparatus including a general playback function.

Note that by adjusting the upper limit (reference value) of the numberof untransmitted fragments, the timing of elimination of one or morefragments in step S26 can be changed, and the priority between the videoplayback delay time and the video playback stop time in an externalapparatus can be selected. For example, in a case where the upper limitof the number of untransmitted fragments is nine, at most nine generatedfragments are played back prior to the fragment immediately after theinterruption of transmission. Here, the maximum playback delay time isabout three seconds (9×333 milliseconds). In a case where the upperlimit is three, the maximum playback delay time is about one second(3×333 milliseconds). That is, compared with a case where the upperlimit is nine, the maximum playback delay time is shortened by about twoseconds. The upper limit can be changed by the control unit 1-4 inaccordance with a request from an external apparatus to which videoframes are transmitted.

However, the playback stop time and the playback delay time have atrade-off relationship. Therefore, in contrast, in a case where theupper limit of the number of untransmitted fragments is nine, comparedwith a case where the upper limit is three, the maximum playback stoptime can be shortened by about two seconds. As described above, higherpriority can be given to the playback delay time as the upper limit ofthe number of untransmitted fragments decreases. On the contrary, higherpriority can be given to the playback stop time as the upper limit ofthe number of untransmitted fragments increases.

Furthermore, by adding a fragment that has not been generated to awaiting-for-transmission queue as a transmitted fragment, the playbackdelay time can be further shortened. More specifically, at a time when afragment whose ID is “11” in FIG. 3 is generated, the fragments whoseIDs are “3” to “11” are eliminated. At the same time, a fragment thathas not been generated and that is before the fragment whose ID is “13”,that is, a fragment whose ID is “12”, is added to awaiting-for-transmission queue in a state where the transmission flagindicates “1”. Even when the fragment whose ID is “12” is generated, thefragment whose ID is “12” is not transmitted, as long as thetransmission flag indicating “1” is registered in thewaiting-for-transmission queue. Here, the fragment whose ID is “12”needs to be eliminated. Thus, playback is resumed not only from afragment 107 starting from the I-frame that is generated immediatelybefore time T₂ in FIG. 5, but also from a fragment 110 starting from anI-frame generated immediately after time T₂.

FIG. 4 is a flowchart of a fragment transmission process performed bythe control unit 1-4 of the video transmission apparatus.

As in the fragment generation process shown in FIG. 2, the fragmenttransmission process starts in response to a video transmission requestreceived from an external apparatus via the network 1-6.

In step S41, the control unit 1-4 checks for an untransmitted fragmentin a waiting-for-transmission queue. In step S42, the control unit 1-4determines whether or not an untransmitted fragment exists in thewaiting-for-transmission queue. In a case where it is determined in stepS42 that no untransmitted fragment exists (NO in step S42), the processproceeds to step S43. In step S43, the control unit 1-4 waits for a timecorresponding to a fragment generation interval. Meanwhile, in a casewhere it is determined in step S42 that an untransmitted fragment exists(YES in step S42), the process proceeds to step S44.

In step S44, the control unit 1-4 causes the communication unit 1-5 totransmit the fragment whose generation time is the oldest amonguntransmitted fragments included in the waiting-for-transmission queue.The determination of which fragment is the oldest can be made by adetermination of which fragment ID is the smallest.

In step S45, in order to determine whether or not video transmission isto be continued, the control unit 1-4 checks for the termination of theconnection with the external apparatus from which the request has beenreceived.

In step S46, the control unit 1-4 determines whether or not theconnection with the external apparatus has been completely terminated.In a case where it is determined in step S46 that the connection withthe external apparatus from which the request has been received is stillactive (NO in step S46), the process returns to step S41 to continue thetransmission process. Meanwhile, in a case where it is determined instep S46 that the connection with the external apparatus has beencompletely terminated (YES in step S46), the control unit 1-4 completesthe fragment transmission process.

Depending on the communication status, transmission of a fragment instep S44 might not be able to be immediately performed. Thus, theprocessing of step S41 may be performed at a long interval. However, thefragment transmission process is performed independently of the fragmentgeneration process shown in FIG. 2, and elimination of one of morefragments in step S26 is regularly performed at a fragment generationinterval. Hence, even in case where the processing of step S41 isperformed at a longer interval due to the communication status, videotransmission can be skipped without any problems.

FIG. 5 is an illustration showing, in a time-series manner, therelationship between fragments transmitted from the video transmissionapparatus and received by an external apparatus before and afterinterruption of video transmission.

Part (a) of FIG. 5 shows fragments stored in the temporary storage unit1-3. Part (b) of FIG. 5 shows fragments actually transmitted from thecommunication unit 1-5. Part (c) of FIG. 5 shows fragments received bythe external apparatus. The abscissa axis of parts (a) to (c) of FIG. 5represents a time axis.

Fragments 101 to 110 are fragments each constituted by three videoframes. The fragments 101 to 103 constitute a GOV, the fragments 104 to106 constitute a GOV, and the fragments 107 to 109 constitute a GOV. Theinitial fragments 101, 104, 107, and 110 of the individual GOVs arefragments each including a reference frame (I-frame), and the otherfragments include P-frames. The fragments in parts (a) to (c) of FIG. 5connected with double-sided broken-line arrows show the same fragment.In FIG. 5, the time required for generation and transmission of eachfragment in the video transmission apparatus is assumed as zero, forsimplification.

For example, in a case where no fragment can be transmitted temporarilyduring a period from time T₁ to time T₂ due to the occurrence of somenetwork trouble, the video transmission apparatus according to thisembodiment resumes transmission from the fragment 107, which includesthe I-frame generated before time T₂ and is the initial fragment of theGOV to which the fragment 108 that was first generated after time T₂belongs. That is, the fragments 103 to 106 are deleted.

In the video transmission apparatus according to this embodiment, thefragment 103, which was generated after time T₁, may be firsttransmitted after time T₂. This is because the fragments 101 and 102 ofthe GOV to which the fragment 103 belongs have been received by theexternal apparatus. In this case, the external apparatus needs to storethe fragments 101 and 102 until the fragment 103 is received. Here, inthe processing for eliminating one or more fragments in step S26 of FIG.2, the control unit 1-4 stores a fragment generated before the oldestfragment including a reference frame in the memory of the temporarystorage unit 1-3, without eliminating the fragment. That is, thefragments 104 to 106 are deleted.

Namely, in the video transmission apparatus according to thisembodiment, as shown in FIG. 5, video frames of the fragments 103 (104)to 106 are deleted and are thus not played back. However, since afragment to be transmitted immediately after interruption includes allthe video frames necessary for playback, the fragment can be played backby an external apparatus without any problems. That is, even in a casewhere an external apparatus includes only a general-purpose networkmedia player, interruption of transmission in units of fragments can behandled. Thus, the number of deleted video frames can be reduced whileplayback delay is reduced.

In normal playback processing in an external apparatus, in a case wheretransmission of a fragment is interrupted, the last video frame of thefragment 102 that was transmitted immediately before the transmissioninterruption is continued to be displayed, as shown in part (c) of FIG.5. Then, after the resumption of transmission of a fragment, playback ofvideo frames of the fragments 103 to 106 is skipped, and playback startsfrom video frames of the fragment 107. In addition, in a case where thefragments 104 to 106 are deleted, after the resumption of transmission,video frames of the fragment 103 are played back. After that, videoframes of the fragment 107 are played back.

As described above, in a case where the number of frames included in afragment is smaller than the number of frames included in a GOV and areception apparatus does not include a decoding unit having a specialfunction, video playback can be continued while the real-time propertyis maintained.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all modifications and equivalent structures and functions.

What is claimed is:
 1. A transmission apparatus comprising: a storageunit configured to store waiting-for-transmission frames; a transmissionunit configured to transmit intra-coded frames and inter-coded frames;and a control unit configured to control the transmission unit such thattransmission is resumed from an intra-coded frame included in thewaiting-for-transmission frames in a case where transmission of thewaiting-for-transmission frames is suspended.
 2. The transmissionapparatus according to claim 1, wherein the control unit controls thetransmission unit such that an untransmitted frame to be decoded inaccordance with an intra-coded frame transmitted before suspension ofthe waiting-for-transmission frame is transmitted.
 3. The transmissionapparatus according to claim 1, wherein in a case where the number offrames that have not been transmitted by the transmission unit hasreached a predetermined number and the transmission of thewaiting-for-transmission frames is resumed, the control unit controlsthe transmission unit such that transmission is resumed from theintra-coded frame included in the waiting-for-transmission frames. 4.The transmission apparatus according to claim 1, wherein the controlunit controls the transmission unit such that frames are discarded fromthe waiting-for-transmission frames in a unit of a fragment.
 5. Thetransmission apparatus according to claim 1, wherein the control unitcontrols the transmission unit such that transmission is resumed fromthe latest intra-coded frame in the waiting-for-transmission frames in acase where transmission of the waiting-for-transmission frames issuspended.
 6. A transmission method performed by a transmissionapparatus, the method comprising: a storing step of storingwaiting-for-transmission frames; a transmitting step of transmittingintra-coded frames and inter-coded frames; and a control step ofcontrolling the transmitting step to transmit such that transmission isresumed from an intra-coded frame included in thewaiting-for-transmission frames in a case where transmission of thewaiting-for-transmission frames is suspended.
 7. The transmission methodaccording to claim 6, wherein the control step controls the transmittingstep such that an untransmitted frame to be decoded in accordance withan intra-coded frame transmitted before suspension of thewaiting-for-transmission frame is transmitted.
 8. The transmissionmethod according to claim 6, wherein in a case where the number offrames that have not been transmitted in the transmitting step hasreached a predetermined number and the transmission of thewaiting-for-transmission frames is resumed, the control step controlsthe transmitting step such that transmission is resumed from theintra-coded frame included in the waiting-for-transmission frames. 9.The transmission method according to claim 6, wherein the control stepcontrols the transmitting step such that frames are discarded from thewaiting-for-transmission frames in a unit of a fragment.
 10. Thetransmission method according to claim 6, wherein the control stepcontrols the transmitting step such that transmission is resumed fromthe latest intra-coded frame in the waiting-for-transmission frames in acase where transmission of the waiting-for-transmission frames issuspended.
 11. A non-transitory storage medium having acomputer-readable program recorded thereon, the program comprising: astorage step of storing waiting-for-transmission frames; a transmittingstep of transmitting intra-coded frames and inter-coded frames; and acontrol step of controlling the transmitting step such that transmissionis resumed from an intra-coded frame included in thewaiting-for-transmission frames in a case where transmission of thewaiting-for-transmission frames is suspended.
 12. The non-transitorystorage medium according to claim 11, wherein the control step controlsthe transmitting step such that an untransmitted frame to be decoded inaccordance with an intra-coded frame transmitted before suspension ofthe waiting-for-transmission frame is transmitted.
 13. Thenon-transitory storage medium according to claim 11, wherein in a casewhere the number of frames that have not been transmitted in thetransmitting step has reached a predetermined number and thetransmission of the waiting-for-transmission frames is resumed, thecontrol step controls the transmitting step such that the intra-codedframe included in the waiting-for-transmission frames.
 14. Thenon-transitory storage medium according to claim 11, wherein the controlstep controls the transmitting step such that frames are discarded fromthe waiting-for-transmission frames in a unit of a fragment.
 15. Thenon-transitory storage medium according to claim 11, wherein the controlstep controls the transmitting step such that transmission is resumedfrom the latest intra-coded frame in the waiting-for-transmission framesin a case where transmission of the waiting-for-transmission frames issuspended.